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Starting from microscopic mechanics, we derive thermodynamic relations for heat conducting 
nonequilibrium steady states. The extended Clausius relation enables one to experimentally deter- 
mine nonequilibrium entropy to the second order in the heat current. The associated Shannon-like 
microscopic expression of the entropy is suggestive. When the heat current is fixed, the extended 
Gibbs relation provides a unified treatment of thermodynamic forces in linear nonequilibrium regime. 



PACS numbers: 05.70.Ln, 05.40.-a, 05.60.Cd 

Thermodynamics (TD) is a theoretical framework that 
describes universal quantitative laws obeyed by macro- 
scopic systems in equilibrium. A core of TD is the Clau- 
sius relation AS — Q/T, which relates the entropy with 
the heat transfer caused by a change in the system. Com- 
bined with the energy conservation, the Clausius relation 
leads to the Gibbs relation T dS = dU -\- fidvi, where 
Ui is a controllable parameter and fi the corresponding 
generalized force. The Gibbs relation is particularly use- 
ful since it represents the forces as gradients of suitable 
thermodynamic potentials. It also played a key role when 
Gibbs constructed equilibrium statistical mechanics. 

Here we wish to address the fundamental question 
whether TD can be extended to nonequilibrium steady 
states (NESS) which, like equilibrium states, lack macro- 
scopic time-dependence. We shall call the possible ex- 
tension Steady State Thermodynamics (SST). The pos- 
sibility of SST is far from trivial since NESS exhibit 
many properties which are very different from equilib- 
rium states. First of all a naive extension of the Clausius 
relation to NESS is never possible since the heat transfer 
Q generally diverges linearly in time. It is also a deep 
theoretical question whether the long range correlation 
universally observed in NESS [H is consistent with SST. 
In addition to such abstract interests, there are nonequi- 
librium phenomena which may be better understood us- 
ing SST. An interesting example is the force exerted on 
a small rigid body placed in a heat conducting fluid 
This force may be understood as a thermodynamic force 
in SST (see [J] for related ideas). 

NESS sufficiently close to equilibrium can be charac- 
terized by the linear response theory. But this theory, 
which requires an ensemble of trajectories in space-time, 
does not lead us directly to SST. It is also clear that the 
theory only gives the result up to the first order in the 
"degree of nonequilibrium." 

Although an extension of TD to NESS (or, equiva- 
lently, a construction of SST) may sound as a formidably 
difficult task, there are at least two branches of studies 
which are encouraging. One is the series of works which 
reveal deep implications on NESS of the microscopic 



time-reversal symmetry. It has been shown that the sim- 
ple symmetry ([1]) leads to various nontrivial results in- 
cluding the Green-Kubo relation, Kawasaki's non-linear 
response relation, and the fluctuation theorem [1, 0]. 
Although none of these works directly treat extensions 
of TD, techniques for characterizing NESS and energy 
transfer may be useful. The other is a series of works in 
which theoretical consistency of SST was examined from 
purely phenomenological points of view. These works 
provide us with some useful guidelines for constructing 
SST. In [6] (see also 7]) it was proposed that heat Q 
in the Clausius relation should be replaced by "excess 
heat" , which is the intrinsic heat transfer caused by the 
change of the state. In [S] it was conjectured that one 
should fix the total heat current J to get a Gibbs relation 
in a heat conducting NESS. 

In the present Letter, we shall report a unification of 
these two branches, which has led us to a microscopic 
construction of SST (see (1, @] for early attempts to con- 
struct SST). More precisely we start from microscopic 
mechanics, and derive a natural extension of the Clau- 
sius relation to heat conducting NESS. The extended 
Clausius relation enables one to experimentally deter- 
mine nonequilibrium entropy to the second order in the 
heat current. This extends the construction of entropy 
for NESS by Ruelle [l3|, who treated a simpler system 
with isokinetic thermostat. We further determine the 
precise form ([4]) of the entropy. In systems with a fixed 
heat current, we derive an extension of the Gibbs rela- 
tion, which enables one to treat thermodynamic forces in 
linear nonequilibrium regime in a new unified manner. 

Setup: Our theory can be developed in various 
nonequilibrium settings including driven or sheared fluid. 
For simplicity we here focus on heat conduction, and con- 
sider a system which is attached to two heat baths and 
has controllable parameters (such as the volume). 

We assume that the system consists of N parti- 
cles whose coordinates are collectively denoted as T = 
(ri, . . . , Tat; Pi, ... , Pat). We write its time-reversal as 
r* = (ri, . . . ,rjv; — Pi, . . . , —Pat). When discussing time 
evolution of F, we denote by T[t) its value at time t, and 
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by r = (r(t))tg[o.T] its history (or path) over the time in- 
terval [0, T]. Given a path F, we denote its time reversal 

asft = ((r(T-t)r),g[o,T]. 

We take a Hamiltonian satisfying the time-reversal 
symmetry H^{T) = H^{r*), where ly is the set of con- 
trollable parameters. Time evolution of the system is 
determined by the Hamiltonian and coupling to the two 
external heat baths with inverse temperatures f3i and P2 ■ 
To model the heat baths, one may use Langevin noise or 
an explicit construction using Hamiltonian mechanics as 
in Our results are valid in both (and other physi- 

cally natural) settings. We shall characterize our system 
using the set of parameters a = {[3i,l32\v). 

An external agent performs an operation to the system 
by changing a according to a prefixed protocol. A pro- 
tocol is specified by a function a{t) — {(3i{t), (32{t); i^{t)) 
oi t € [0,T]. We denote by a = (Q:(i))te[o,T] the whole 
protocol. Again d^^ = {a{T — t))t(z[o,T] denotes the time- 
reversal of d. By (a) we denote a protocol in which the 
parameters are kept constant at a. 

Consider a time evolution with a protocol d, and de- 
note the probability weight for a path T as WQ[r]. It 
is normalized as Jj^^q^_j^ /DTWalT] — 1 for any initial 

state Fi, where VT denotes the path integral over all the 
histories (with the specified initial condition). 

Time-reversal symmetry: Let Jfc(F;t) be the heat 
current from the k-th bath to the system at time t in the 
history F. Then the entropy production rate at t is given 
by d&{r;t) = -Yl\=ih{t) Jk{t]t). By integration, we 

get the entropy production QcJX) — lo dtOaiJ^] t). 

Then it has been shown [1, |Tl| that the present (and 
other physically realistic) time evolution satisfies 



(1) 



which is the basis of the present work. 

Steady state and its representation: We assume that 
the system settles to a unique NESS when it evolves for 
a sufficiently long time with fixed a. We take T much 
larger than the relaxation time. We treat NESS with a 
small heat current, where convection hardly takes place. 

In the NESS characterized by a, the expectation value 
of the current Jfe(F;t) takes a constant value, which we 
denote as Jfc(a). We define the excess heat current from 
the /c-th bath as Jl%t-t) = Jk{t;t) - Jfe(a(t)). Then 

emr;t) = -ELi/3fcWCa(r;0 and its integration 
— lo dt6'^{t;t) are the excess entropy produc- 
tion rate and the excess entropy production, respectively. 

We denote by Pq(F) the probability distribution for 
the NESS characterized by a. By using ([1]), it was shown 



I4I (see also [ll|) that the distribution has a concise 



representation 



Pa (r) = exp -S{a 



/Cvex \(«) 



/Cvex \(") 
W(a)/r',st 



-i?(a,F) 
(2) 



where S{a) is determined by normalization, and 
^(a,F) = 0{e^). Here the "de gree of nonequilibrium" 
e is a dimensionless quantity proportional to the typical 
heat current. Throughout the present Letter, (• ■ • )p. p^. 
stands for the expectation taken with respect to the path 
probability Wa [F] with the initial and the final conditions 
Fi and Ff, respectively, where "st" denotes the steady 
state 13|. The representation ^ plays a fundamental 



role in our construction of SST. 

Extended Clausius relation: Our first result is a nat- 
ural extension of the Clausius relation. 

Let d be an arbitrary quasi-static protocol in which the 
parameters change slowly and smoothly from — a{Q) 
to Off = oi{T). Then the extended Clausius relation is 



(3) 



where R{a) is a small error about which we discuss 
shortly. (Here, and in what follows, (•■•)" is a short- 
hand for (• • • ,t.) Eq. © is the core of our SST. 

When (3i =02, we can show R{a) — 0, and hence ([3]) 
becomes precisely the standard Clausius relation. Note 
that the heat current in the original relation has been re- 
placed in the extended relation ([3]) by the excess heat cur- 
rent, following the phcnomcnological proposals in [11,01. 
Although the excess entropy production {Q'^)" appears 
to depend on paths (in the parameter space) defined by 
the protocol d, ^ shows, rather strikingly, that it can 
be written as the difference of the entropy S{a), which is 
a function of a. This is far from a mere consequence of 
definitions, and represents a deep fact that NESS possess 
a nontrivial thermodynamic structure. 

For an infinitesimal protocol d [HI , we will show that 
i?(d) = O(e^A), where A is a dimensionless quantity 
which characterizes the change at — ai [3]. (We know 
from examples that this error estimate is optimal.) 

The error term i?(d) for a general quasi-static proto- 
col d can be obtained by summing up the errors in in- 
finitesimal steps. In general 0{A) sums up to 0(1), thus 
giving R{a) = 0{e^). There are, however, important 
cases where we can set R{a) = 0{e^). In such a case, 
the extended Clausius relation ^ is correct to O(e^), 
and hence goes beyond the linear response theory. Take, 
for example, the initial state ai as an equilibrium state 
with f3i — ^2- If we fix /3i and change only 02, the error 
0(e2 A) sums up to R{a) = 0{e^) (see also 0). 

Nonequilibrium entropy: S{a) in ([3|) was introduced 
as the normalization factor in the representation ([2]). It 
is interesting that this quantity plays the role of entropy 
in an operational thermodynamic relation. 

In [17|], we shall show that this entropy has an inter- 
esting symmetrized Shannon-like expression 



Sia) 



dFp^'(r) logyMiT)^* 



(4) 



Note that the right-hand side becomes precisely the 
Shannon entropy if p^'(F) = p^*(F*). Since the equi- 
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librium distribution has this symmetry, the entropy S{a) 
approaches the Shannon entropy in the equihbrium hmit. 

The expression (j4]) shows that S{a) reflects certain 
properties of the steady state distribution Po*(r). Of 
particular interest is the long-range correlation [ij] , which 
should manifest itself as an anomalous size dependence 
of S{a) in the second order in e. As we have exam- 
ined above, the extended Clausius relation ^ allows one 
to compare the nonequilibrium and the equilibrium en- 
tropies, and determine S{a) in NESS with precision of 
O(e^). One can thus detect the long-range correlation 
experimentally by means of calorimetry. 

Extended Gibbs relation: Our second major result is 
an extension of the Gibbs relation. 

Let P be an arbitrary reference. Using the energy con- 
servation, and noting that Jk{oi) — 0, we get 

0-(f) = /3{w-a(f)-fi/,(o)(r(o))-i/,(r)(r(r))}-i-$5(f ), 

(5) 

where Wa (r) is the total work done by the external agent 
who changes the parameters ly (the temperatures of the 
baths are changed without doing any work), and we de- 
fined $<i(f) - - ELi /o^ dtiPkit) - P) r,%it; t). 

If the average ($q)" happens to be negligible, then ^ 
and the extended Clausius relation ([3]) imply 



Hamiltonian changes, ([6]) gives 



dS = 



dU 



^ dvi 



T 



A), 



(6) 



where we wrote (VFa)" = — ^ ^ /i (a) di^i , with v = 
(j/i, j/2, . . .), and /i(a) being the (generalized) force con- 
jugate to Vi. Remarkably, © is identical to the standard 
Gibbs relation. We stress that all the terms in ^ can be 
determined experimentally by measuring heat currents 
and mechanical forces. 

There may be several ways to make negligible. A 

natural strategy that comes from the phenomenological 
proposal in Q is to consider a system with a fixed heat 
current J. To be more precise, we consider a "source- 
drain system" , in which the two baths have different char- 
acters. The bath 1, which has a lower temperature and 
coupled efficiently to the system, is a "heat drain." It 
helps the system to get rid of extra energy and reach 
the NESS rapidly. The bath 2, which has a higher fixed 
temperature, is a "heat source." It supplies a constant 
heat current J to the system in average when the system 
is disturbed by an external operation [l8| . This means 
that {J'^(J\t))'^ is negligible. We now choose the refer- 
ence as 'li = /3i(0) so that /3i(i) - /3 = 0(A). Since 
{J^S))^ = 0(A), we find that is 0(A2) and 

hence negligible. 

In a source-drain system, it is natural to characterize 
the NESS by parameters (T, J, v), where T = (/32 
is determined from T, J, and v?) If we restrict ourselves 
to the operations in which only the parameter v of the 
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dv, 



FiT,J,iy) + 0{e^), 



(7) 



where the nonequilibrium free energy is defined by the fa- 
miliar relation F ~ U — TS. The relation ([7]) shows that 
any thermodynamic force (including that exerted on a 
body in a heat conducting fluid) in the linear nonequi- 
librium regime is indeed a conservative force with the 
potential F(T, J, v). Although any physical quantity can 
be evaluated to 0(e) by using the linear response the- 
ory, ([7]) may provide a novel point of view for analyz- 
ing thermodynamic forces in the setting with a fixed 
current. For example, ([7]) implies the Maxwell relation 
dfi/dvj = dfj/dvi -f O(e^), which may be confirmed ex- 
perimentally in suitable settings. 

Derivation of main equality We consider 

an infinitesimal protocol d [IJ]. Noting that 
0^t(ft) = -&a{r), O implies Wa[f]e-Q^''(r)/2 ^ 

Wat [r'''] e~®a+ By integrating over all paths sat- 
isfying r(0) = Ti, r(r) = Tf , we get 



pt(rf)(exp[-e-/2] 



p^',(rr)(exp[-e-^./2] 



r-,r* 
(8) 



which is our starting point. We later show that 



exp[-0r/2] 



exp[-e-^72] 



r;,r* 



exp 



(0r);,,r,-(0^l)r;,rr 



i?'(a;ri,rf) (9) 



with i?'(d;ri,rf) = 0(e3) + 0(e2 A). We here assume 
that various quantities can be expanded both in e and 
A. We regard A as infinitesimal and omit O(A^). 

Note that (0:j")?.,rf = lo dt {ei^{t))f^ r, holds, and 
{d'^{t))p. attains non-negligible values only when t is 
near 0, T, or T/2 (where the system is out of steady 
states either by the imposed conditions or the operation) . 
We can therefore decompose the expectation value as 

(0:r)^.,p, = (e^^o)St+(0(«.)>lS+(0^>^.f (10) 

By substituting ^ and pll|) into the identity ([5]), and 
comparing the result with the representation we get 

S{a,)-S{a,) ^ i{(0^.)f ^^-(0^'^);^^}-,i?(a), (11) 

where R{a) = R'{&- T;, Tf ) - ^(ai, T;) + R{af, Tf ). Since 
R{a) = if A = 0, we must have that R{a) = 0{t^ A). 
Noting the symmetry = -(0r)lst iHl we get 

([5]) for an infinitesimal process. 
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Derivation of ([9]); We regard (only in this deriva- 
tion) time-independent ify(o) as the Hamiltonian of 
the system, and interpret the force from i?,y(t) ~ 
i?^(o) an "external force." Then the energy bal- 
ance implies if,(o)(r(T)) - if,(o)(r(0)) = VF(f) + 
J2k=i Jo Jk^i^'^ where WK(r) is the total work done 
by the "external force". By defining ^^(f) = <f>Q(f) -I- 
(}W(T), we have ef^(f) = ^^(f) + /3{i?.(o)(r(0)) - 
i?,(o)(r(T))} as in ©. 

To simplify notation, we drop a or a\ and abbrevi- 



ate the expectations 



'ri,rj 



and 



/r*.r: 



as 



■ ) and 



■y , respectively. We make use of the cmiiulant expan- 



logJiT 



0(l'3). 
(12) 



To evaluate the second term, we observe that 



(I.; I.) - (I.; $)t = ($; - ($; $}t^ + 0(1.3), (13) 

where (• ■ • )eq and (• • • )Jq are averages in the correspond- 
ing equilibrium dynamics with the static Hamiltonian 
H and a common /3. But the time-reversal symme- 
try in equilibrium dynamics implies ($; $)eq — ^)lq- 
Since $ = 0(e) [H and /3iy = 0{A), we have $ = 
0(e) 0(A). Thus dUl) and ([121) imply the desired ©. 

Discussions: We treated a general classical model of 
heat conduction, and derived natural nonequilibrium ex- 
tensions of the Clausius and the Gibbs relations. The 
mere existence of a consistent operational thermodynam- 
ics (i.e., SST) may be of great importance, but the way 
the extension has been done may also be quite suggestive. 

The extended Clausius relation ([3]) and the associated 
microscopic expression ^ of the entropy form a theoret- 
ical core of the present work. They may provide us of 
a clue to develop a statistical mechanics for NESS that 
works beyond linear response regime. 

It is also suggestive that we obtained the extended 
Gibbs relation ([S]) in a special setting with "source" and 
"drain" , in which the heat current is fixed. There is a 
possibility that this special setting is necessary for un- 
covering universal statistical properties of heat conduct- 
ing systems, which properties are hidden in other set- 
tings. In this connection, it is exciting to explore impli- 
cations of the "nonequilibrium order parameter" defined 
as *(T, J, ly) = dF{T, J, iy)/dJ Q. 

We hope that the present results trigger further non- 
trivial developments in nonequilibrium physics. 
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To be precise, we define expectations with various initial 
and final conditions as follows. We omit a for simplicity. 

(,f>r„r, = {pS,(rf)}-i/r(o)=r.,r{r)=r,^fW[f]/(f), 

(,f>r.,st = /r(„)^r^OTW[fi/(f), (/),t,r, = 
{P%im-' /r(r)=r, pS.(ri) W[f] /(f), and 
(,f>st,st = /of pS,(ri)W[f]/(f). Here the nor- 
malization factors are simplified by assuming that 
P%i^i) = /r(0)=r.,r(r)=r,^f W[f] for any L;. 
An infinitesimal protocol a is defined by a{t) — ai for 
t e[0,T /2) and a{t) = at for t € [T /2, T], where at - m 
is infinitesimal. 

Let Af3 be the typical change in the inverse temperature, 

and W be the typical work done according to the change 

of V. Then A Eo A[3 + (3W , where Eo = Jmax n (see 

[3) is a typical energy scale. 
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Although not all heat baths act as a "heat source", one 
can design various source (without violating the basic as- 
sumption lU) which keeps the averaged current almost 
constant when the parameters are changed. An exam- 
ple is a bath with a very high temperature coupled very 
weakly to the system [13] 

We assume that the typical current in the system is J ~ 
K 5(3 when there is a difi'erence 5(3 in the inverse tempera- 
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turcs of the baths. Since the average of $ is vanishing, we 
examine its behavior when the system is disturbed into 
a non-tjrpical state. Then one expects a large current of 
the order Jmax ^ Kf3. Since this decays rapidly within the 



relaxation time Tr, we see $ ~ 5/3 Jmax Ti ^ B Tr ~ e, 
where Jss ~ k;(5/3 is the current in the steady state. 



